This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the appHcant. 

Defects in the images may include (but are not Umited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SBDES 

• FADED TEXT 

• ILLEOroLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY, 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



PCT 



WORLD INTEUXCrUAL PROPERTY ORGANIZATION 
bitenutional Bureau 




INTERNATIONAL APPUCATION PUBUSHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) IntemaUonal Patent Classification ^ : 
H04L 12/46 



Al 



(11) International Publication Number: WO 97/47113 

(43) InternatioDal Publication Date! 1 1 December 1997 (U.I 2.97) 



(21) Internallonal Application Number: PCT/US97/09552 

(22) International Filing Date: 2 June 1997 (02i)6.97) 



(30) Priority Data: 
08/657.414 



3 June 1996 (03.06.96) 



US 



(71) Applicant CABLETRON SYSTEMS, INC. (USAJSJ; 35 

Industrial Way. P.O. Box 5005. Rochester. NH 03867-5005 
(US). 

(72) Inventors: BELSER. David; 30 River Road, Pcnacoolc. NH 

03303 (US). BUSSIERE. Richard; 612 Belmont Street, 
Manchester, NH 03104 (US). CIOU. Jeff; 69 Ovcrlcdge 
Drive, Deny. NH 03038 (US). FEE. Brendan; 34 Pcmbcrton 
Road, Nashua, NH 03036 (US). HAGGERTY, William. H.; 
244 Pond Street. Dunstable, MA 01827 (US). 

(74) Agent: HENDRICKS, Thcresc, A.; Wolf, Greenfield & Sacks. 
P.C., 600 Atlantic Avenue, Boston, MA 02210 (US). 



(81) Designated Stales; AL. AM, AT, AU. AZ. BA, BB. BG, BR, 
BY, CA. CH, CN. CU. CZ, DE, DK, EE. ES. Ft GB, CE 
HU. IL. IS. JP, KE, KG, KP. KR, KZ. LC. LK. LR, LS. 
LT. LU, LV, MD. MG, MK. MN, MW, MX. NO. NZ, PL, 
PT. RO, RU, SD, SE. SG. SI. SK. TJ, TM, TR, TT. UA. 
UG, UZ, VN. ARIPO patent (CH. KE, LS, MW, SD, SZ, 
UG), Eurasian patent (AM, AZ. BY. KG. KZ. MD, RU. TJ, 
TM), European patent (AT. BE. CH, DE. DK, ES, FI, FR, 
GB, GR, IE. IT. LU. MC. NU PT, SE). OAPI patent (BF, 
BJ, CF. CG, a, CM. GA. GN. ML. MR, NE, SN. TD. TG). 



Published 

With intematiomi search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) TlUe: CONNECTION AGGREGATION IN SWITCHED COMMUNICATIONS NETWORKS 




(57) Abstract 

A method and apparatus arc provided for connection-oriented switching in a conmiunications network whertio a pre-established path 
is established between a select pair of an ingress switch and an egress switch. The use of pre-established paths enables a reduction in the 
total number of connections required inside the switch cloud, reduces the CPU load on trnnk switches, and shortens the time for connection 
setup. In the embodiment described, the DA/SA fields of a MAC frame data packet are replaced with a 'Virtual path", which identifies the 
prc^tablished path between the ingress and egress switches. A ^Virtual circuit" is provided in another field of the modified packet whu;h 
specifics die out-port and out-header on the egress switch for demultiplexing the modified packet upon receipt at the egress switch. The 
virtual circuit is exchanged between the ingress and egtcss switches at connection setup. The virtual path b assunrtcd to already be in place, 
and known to both switches, prior to coimection setup. 
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. 1 . 

CONNECTION AGGREGATION IN 
SWITCHED COMMUNICATIONS NETWORKS 

5 

Field of the Invention 
This invention relates to a method and apparatus for providing connection 
aggregation witliin a switched communications network in which pre-established paths are 
provided in order to reduce the total number of connections required between switches. 

10 

Background of the Invention 
Most data conmiunicaiions networks today rely heavily on shared-media, packet- 
based LAN technologies for both access and backbone connections. These networks use bridges 
and routers to connect multiple LANs into global internets. However, such router-based 

15 networks cannot provide the high bandvridth and quality of service required by the latest 
networking applications and new faster workstations. 

Switched networking is a proposed solution intended to provide additional 
bandwidth and quality of service. In such networks, the physical routers and hubs are replaced 
by switches and a management system is optionally provided for monitoring the configuration of 

20 the switches. The overall goal is to provide a scalable high-performance network where all links 
between switches can be used concurrently for connections. 

One proposal is to establish a VLAN switch domain. A VLAN is a "virtual local 
area network" of users having full connectivity (sharing broadcast, multicast and unicast 
messages) independent of any particular physical or geographical location. In other words, users 

25 that share a virtual LAN appear to be on a single LAN segment regardless of their actual 

location. Although the term "VLAN" is widely used as a new method of solving the increasing 
demand for bandwidth, the effectiveness of existing VLAN systems is wholly dependent on the 
particular implementation. For example, a VLAN implementation which allows VLAN 
assignments to end systems, as well as ports, provides a more effective means of VLAN 

30 groupings. Other performance-determining characteristics include the manner of resolving 
unknown destination and broadcast traffic (which consume both network bandwidth and end 
system CPU bandwidth), the ability to allow transmission out multiple ports, hop-by-hop 
switching determinations (as opposed to determination of a complete path at the call-originating 
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switch), and whether multi-protocol routers are required lo enable transmission between separate 
VLANs. 

Each of these may have an important effect on the total number of connections in 
trunk switches, the CPU load in the trunk switches, the speed of connection setup, and the 
scalability of the system, i.e., ability to maintain performance with increasing numbers of end 
stations and/or switches. 



Summary of the Invention 

In accordance with the present invention, a method and apparatus are provided for 
connection-oriented switching in a communications network. In a connection-oriented 
communication, a logical association is established between a source end station and a 
destination end station, so that several separate groups of data ("a data flow") may be sent along 
the same path that is defined by the logical association. This is distinguished from 
connectionless communications, wherein each frame of data is transmitted node-by-node 
independently of the previous frame. 

In general, there are three phases which occur during a connection-oriented 
communication: connection establishment; data transfer; and connection termination. In the 
connection establishment phase, the first time a source has data to be sent to a destination, a 
logical association, also called a connection or a path, is established between the source and the 
destination. The connection defines nodes and connections between the nodes, for example, the 
switches between the source and destination, and the pons of the switches through which the 
data will pass. The path set up at the establishment phase is the path on which the data will be 
transmitted for the duration of the active connection. During the data transfer phase, data is 
transmitted from the source to the destination along the connection, which includes the pori-to- 
port connections of the switches. Generally, after a certain amount of time, or at the occurrence 
of a certain event, the connection enters the termination phase, in which the connection is 
terminated, and the switches which made up the connection are freed to support other 
connections. 

In accordance with the present invention, a technique referred to as "connection 
aggregation" is provided in order to reduce the total number of connections required between the 
switches (i.e., inside the sv^dtch cloud). Connection aggregation entails providing a pre- 
established path between a select pair of an ingress switch (connected to the source end station) 
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and an egress switch (connected to the destination end station). By establishing predetermined 
paths, only the ingress and egress switches need be involved in the connection setup phase, 
thereby reducing the connection setup time. In addition, providing predetermined paths reduces 
the number of connections required lo be maintained in the trunk switches, and reduces the CPU 

5 load in each trunk switch. 

In accordance with the invention, a "virtual paih ID" is used to describe the path 
to be taken between an ingress device and egress device (i.e., switches). A "virtual circuit ID" is 
used to describe which two endpoints (i.e.» source and destination end stations) are attached by 
the virtual path. In one embodiment described herein, the destination address (DA) and source 

10 address (SA) fields in a MAC frame packet are replaced with the virtual path ID, the virtual 
circuit ID is inserted in a VLAN-ID field, and a packet identifier marking this as an aggregated 
packet is added to create a modified packet which is then sent on the pre-established path to the 
egress switch. In this embodiment, the 96-bit virtual path ID includes a 48-bit destination MAC 
address of the in-port of the egress switch (to which the destination end station is connected). 

15 The virtual path ID also includes a 24-bil path identifier (02:PP:PP) in which the local 

administered bit is set, and the remaining 16 bits (PP:PP) identify one of 65K unique paths to the 
egress switch. Because the virtual path ID must be unique not only to a particular switch, but 
also unique within the switch cloud, the last 24 bits (of the virtual path ID) contain the lower 24 
bits of the ingress switch MAC address (XX:YY:ZZ). The ingress and egress switches exchange 

20 their MAC addresses so each has the necessary information. Each switch on the predetermined 
virtual path has been set, prior to the connection setup phase, by for example entering a 
connection in its switching table (cormection database) which maps an in-port and out-port to the 
virtual path ID. 

The virtual circuit ID is assigned during the connection setup phase by the egress 
25 switch and sent to the ingress switch in response to the connection request. When the modified 
packet is received by the egress switch, the virtual circuit is used to restore the original packet in 
order to send the restored packet to the destination end station. The other switches in the path, 
between the ingress and egress switches, do not need to use the virtual circuit field in the 
forwarding decision. 

30 These and other aspects of the present invention will be more fully described in 

the following detailed description and drawings. 
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' Brief Description of the Drawings 
Fig. 1 is a schematic logical representation of a pre-established path in a switch 
cloud between an ingress switch and egress switch, connecting a source end station and 
destination end station in accordance with this invention; 
5 Fig. 2 A is a portion of a MAC frame data packet sent by an end station, showing 

select fields, and Fig. 2B shows the corresponding fields of a modified packet as determined 
during connection setxip by the ingress switch; 

Fig. 3 A is a schematic logical representation of a pre-established path between a 
source end station and destination end station, and Fig. 3B shows the corresponding portions of 
10 the data packet as it is transmitted from the source, through the ingress switch, cloud switch and 
egress switch to the destination; 

Fig. 4 A, 4B, 4C, are flow charts illustrating steps performed at the ingress switch 
and data packet transmission; 

Fig. 5 is a schematic logical representation of a VLAN switch domain, including 
15 multiple VLANs; 

Fig. 6A-6B is an example of a local directory cache; 
Figs. 7A-7C are examples of the following databases: link state, link state 
neighbor, and link sUte switching, respectively; 

Fig. 8 is a schematic illustration of a portion of a switched network to illustrate an 
20 example of a path determination service; 

Fig. 9 is a schematic illustration of a network topology built with FPS switches; 
Fig. 10 is a schematic illustration of an FPS switch; 
Fig. 11 is a logical view of an FPS switch; 

Fig. 12 is a schematic illustration of a VLAN domain, illustrating the management 
25 of the VLAN switches; 

Fig. 13 is a schematic illustration of a computer apparatus. 

Dfttailf ^ Description 
Figs. M illustrate generally the connection aggregation scheme of the present 
30 invention. Figs. 5-13 provide a more detailed description of a specific embodiment and 
implementation of the invention. 
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Fig. 1 shows a switch cloud 10 including a plurality of trunk switches 16, 17, 20 
and 21. A pre-established path 12 is provided between an ingress switch 1 5, connected to a 
source end station 14. and an egress switch 18. connected to a destination end station 19. The 
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pre-established path includes trunk switches 16 and 17 between ingress switch 15 and egress 
switch 18. 

Figs. 2-4 illustrate by way of example how a MAC frame data packet is modified 
to enable switching along the pre-established path. It is assumed, as will be described later, that 
the virtual path 12 is already in place, and known to all switches 1 5, 16, 1 7, 1 8 on the path, prior 
to connection setup. 

A MAC frame packet is sent from source end station 14, which is intended for 
destination end station 19. The packet includes a header portion 30 which includes the fields 31- 
34 shown in Fig. 2A. Field 3 1 , labeled "DA", is the unique MAC (Media Access Control) 
address of the destination end station 19. Field 32, labeled "SA", contains the MAC address of 
the source end station 14. Field 33, labeled "Ether Type", contains the IEEE defined VLAN 
(L1/L2) type field. Field 34, labeled "VLAN ID", is an optional field. 

A "MAC frame" packet is a connectionless packet as described in IEEE 
Publication 802.3. As described therein, a MAC frame generally contains the following fields: 
preamble; start frame delimiter; destination address; source address; type/length field; payload 
(i.e., data and padding); and firame check sequence. 

The data packet containing header 30, is transmitted to ingress switch 1 5, where 
the header portion 30 is modified to become header portion 40. As shown in Figs. 2A-2B. the 
header portion 40 includes three fields, which correspond to the fields in header portion 30 
connected by dashed lines. The combined fields 31 and 32 (DA and SA) become the virtual path 
field 4 1 . The Ether Type field 33, which is modified to contain a packet type identifier which 
indicates that this is an aggregated packet, becomes the Ether Type field 45. The VLAN ID field 
34 becomes the virtual circuit field 46, 

In this disclosure, a field may be modified by inserting or overlaying the new data 
in a field; thus, modifying a packet by "adding" information is meant to include inserting and/or 
overlaying. In addition, the specific fields which may be modified are not limited to those 
modified in the present embodiment; depending on the application, another field may be utilized. 

The virtual path identifies the pre-established path to be taken between the ingress 
switch 15 and egress switch 18. As shown in Fig. 2B, the virtual path field 41 has three portions 
42-44. The first portion 42 contains the 48-bit MAC address of the egress switch and its port 
instance which connects to the destination end station 19, The second portion 43 contains a 24- 
bit path identifier (02:PP:PP). in which the local administered bit is set and PP:PP identifies one 
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of 65K unique paths to the egress switch. The third portion 44 contains the lower three bytes (24 
bits) of the MAC address of the ingress switch 1 5 (XX:YY:ZZ). This scheme guarantees that the 
96-bit virtual path (in field 41) is unique within the switch cloud. Ether Type field 45 contains 
the packet identifier 48 and virtual circuit field 46 contains the out-port and out-header 47 on the 

5 egress switch 1 8. 

Fig. 4A is a flow chart illustrating the steps performed at the ingress switch. In 
step 49, a N4AC frame data packet arrives at the ingress switch 1 5 from the source end station 14. 
A look-up is performed on the DA-S A (and any other relevant fields) and the DA-S A fields 3 1 - 
32 are replaced with the virtual path ID 41 (step 50). The look-up table provides mappings 

10 between the source and destination MAC addresses and the egress switch/port MAC address 42, 
the path identifier 43, and the lower three bytes of the ingress switch MAC 44. The Ether Type 
field is modified to include the packet identifier (step 51). In addition, the virtual circuit is 
inserted in the VLAN field 34 (step 52), To accomplish this, the DA/SA is sent by the ingress 
switch to the egress switch as part of a connection request; the egress switch then maps a new 

1 5 coimection in its lookup table (database) in which it assigns a virtual circuit ID number to the 
connection and stores the DA/SA in its table; the egress switch then sends the virtual circuit ID 
back to the ingress switch (in response to the connection request). The packet thiLS modified (by 
the ingress switch) is forwarded to the next switch (step 53), which in this case is cloud 
switch 16. 

20 As illustrated in the flow chart of Fig. 4B, the modified packet arrives at cloud 

switch 16 (step 60). A look-up is performed based on the virtual path ID to determine the out- 
port (step 61). Then, the modified packet is forwarded from this out-port to the next switch 
(step 62). 

After similar transmission through cloud switch 1 7, the modified packet arrives at 
25 egress switch 1 8 (step 70 in Fig. 4C). A connection look-up is performed based on mapping the 
virtual path ID and virtual circuit ID to the out-port and out-header, to enable restoration of the 
original MAC frame packet and transmission to the destination end station (step 71). The virtual 
path in the modified packet is replaced with the DA/SA (step 72), the virtual circuit is removed 
from the VLAN field (step 73), and the packet identifier in the Ether Type field is replaced with 
30 the original information. The restored (re-assembled) original packet is then forwarded to the 
destination end station (step 74). Thus, the packet that came into the cloud is the same as the 
packet that comes out of the cloud. 
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There will next be described a specific embodiment for implementing the present 
invention. Various aspects of this embodiment may be more particularly described in copending 
and conunonly owned U.S. Serial No. 08/626,596 entitled "Distributed Connection-Oriented 
Services For Switched Conmiunications Networks," filed April 2, 1996 by K. Dobbins et al., and 

5 hereby incorporated by reference in its entirety. 

FIG. 5 illustrates generally a logical view of an exemplary switched network with 
end systems (stations) on different VLANs. The representative network 1 1 0 has four switches 
II 1-114, all of the switches being connected in a meshed topology by physical links 1 15 
between network ports forming, e.g., point-to-point connections. The plurality of end systems 

10 120-1 3 1 extend from access ports on various switches. The end systems are grouped into 

different subsets which have different VLAN identifiers (VLAN-IDs): default VLAN (117), red 
VLAN (118), and blue VLAN (119), respectively. As shown in FIG. 5, red VLAN includes end 
systems 120, 122, 125, 128 and 130, and blue VLAN includes end systems 121, 123, 124. 126, 
127, 129 and 131. Default VLAN is a special VLAN to which all ports and end systems are 

15 initially assigned; after being reassigned to another VLAN, they arc removed from the default 
VLAN. 

The operation of this exemplary VLAN network will be discussed under the 
following subsections: 

► Directory Administration 

20 Link State Topology Exchange 

► Path Determination. 

Directorv Administration 

During a discovery time, each switch discovers its local connected end systems 
25 (i.e., switch 1 1 1 in Fig. 5 discovers end systems 120-122) in order to provide a mapping of end 
system MAC addresses to access ports, as well as a mapping of end system MAC addresses (or 
access ports) to VLAN-IDs. In this particular embodiment, a local directory is provided (see 
Figs. 6A-6B) which contains all node-related information including: 

► the node (e.g., machine address of the end system) 

30 ► any upper layer (alias) protocol addresses discovered v^dth the node 

► the VLAN-IDs to which the node is mapped 
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► the local switch' port(s) on which the node was discovered (plural for redundant 
links) 

the owner switch(es) hardware address (plural for redundant access switches). 

5 As shown in Fig. 6A, the local directory of nodes includes in coiunui order: the 

"Switch Port" (to which the end system is attached); the "Device MAC Address" (for the 
attached end system or switch); the "Node State" ("local" for an attached end system, "virtual 
node" for an attached switch); "Call Tag" (for the call associated within this entry); "Last Heard" 
(the elapsed time since the attached device was last heard from); "Age" (the time since the node 

10 was discovered); "Alias Count" (the number of alias* mapped to the MAC end system); and 
"VLAN Count" (die number of VLANs to which the entry belongs). 

Fig. 6B includes a mapping of user MAC address to higher-layer protocol 
("alias") addresses, such as network layer addresses, client addresses and server addresses. Use 
of these higher- layer protocol addresses enables a VLAN management application to verify or 

15 place users in the correct location. For example, if a red VLAN maps to IP subnet 42, then the 
network layer mappings for all red VLAN users should show an IP address that also maps to 
subnet 42. The Local Directory with alias address information as shown in Fig. 6B includes the 
fields: "Owner Switch" (the owner of the attached end system); "Switch Port"; "Device MAC 
Address"; "Alias Type" (e.g., IP or IPX); "Alias Address"; "VLAN Policy" (discussed 

20 hereinafter); and "VLAN-ID" (e.g., red, blue, default). 

The end system and/or VLAN mqjpings may be provided by an external 
application. Whether the mappings at each local access switch are done implicitly (e.g., by using 
a mapping criteria table or protocol-specific mappings) or explicitly (e.g., by using an external 
management application), the key point is that each access switch only maintains its locally 

25 attached users. Taken as a group, this combination of local directories provides a "Virtual 
Directory" which can easily scale to fairly large numbers of users. 

Assignment of VLANs to individual ports is the simplest embodiment to 
administer and to engineer in a switch. A switch port can be assigned to more than one VLAN; 
however, all users on a port with multiple VLANs will see all of the cross-VLAN traffic. 

30 Alternatively, VLANs can be assigned based on IP subnets or end system MAC addresses. 

In order to provide connectivity "out of the box" (prior to any VLAN 
administration), by default all switch ports and end systems belong lo a common VLAN (for tag- 
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based flooding), known as the default VLAN 1 19 (see Fig. 5). Once a port or end system is 
assigned to a specific VLAN, it is automatically removed from the default VLAN. 

It may also be desirable to have VLAN switches discover and automatically place 
end systems in one or more reserved VLANs. For example, as switches discover IPX servers, 
5 they would be placed in the "IPX server" VLAN. 

External services may communicate with the local directory via its application 
programming interface (API). Information may be added to the directory by those applications 
that require node-related information to make switching decisions. The directory maintains the 
node infonnation based on a set of rules, until the node is removed. External services may also 
10 request for a node to be deleted via the API. 

As implemented in an object-oriented programming language, such as C-»-+, the 
directory may comprise a class which provides the common API and manages the directory 
nodes and any tables used for queries. For example, the directory node table (Fig. 6a) and 
directory alias table (Fig. 6b) enable bi-directional queries, e.g., node-to-alias, or alias-to-node. 

15 

Link State To pology Exchange 

A path determination eilgorithm is used to determine the pre-established paths 
between switches. For example, a shortest path may be chosen based upon metrics such as 
summation of link cost, number of calls allocated on each link in the path, etc. Alternatively, 
20 multiple equal-cost paths to a given destination may be chosen to provide load balancing (i.e., 
distribution of the traffic over the multiple paths equally). However, before a path to a 
destination can be chosen, the inter-switch topology must be determined. 

In this embodiment, a specific link state protocol is defined for the determining 
the inter-switch topology. For a general discussion of link state routing, see Radia Perlman, 
25 ''Interconnections: Bridges and Routers" (Reading, Mass: Addison- Wesley, 1992), pages 221- 
222. Other link state protocols may be used in the present invention in order to enable path 
determination. 

There are four basic components of a link state routing method. First, each switch 
is responsible for meeting its neighbors and learning their names. Hello packets are sent 
30 periodically on all switch interfaces in order to establish and maintain neighbor relationships. In 
addition, hellos may be multicast on physical media having multicast or broadcast capability, in 
order to enable dynamic discovery of a neighboring switch. 
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All switches connected to a common network must agree on certain parameters, 
e.g., hello and dead intervals, etc. These parameters are included in the hello packets; differences 
in these parameters will inhibit the forming of neighbor relationships. For example, the hello 
interval designates the number of seconds between a switch's hello packets. The dead interval 
5 defines the number of seconds before declaring a silent (not heard from) switch down. The hello 
packet may further include a list of neighbors, more specifically the switch IDs of each switch 
from whom valid hello packets have recently been seen on the network; recently means in the 
last dead interval. 

A second basic component (of a link state method) is that each switch constructs a 
10 packet known as a "link state packet" or "LSP" which contains a list of the names and costs to 
each of its neighbors. Thus, when an adjacency is being initialized, "database description 
packets" are exchanged which describe the contents of a topological database. For this purpose, 
a poll-response procedure is used. One switch is designated a master, and the other a slave. The 
master sends database description packets (polls) which are acknowledged by database 
15 description packets sent by the slave (responses). The responses are linked to the polls via the 
packet's sequence numbers. 

The main portion of the database description packet is a list of items, each item 
describing a piece of the topological database. Each piece is referred to as a "link state 
advertisement" and is uniquely identified by a "link state header" which contains all of the 
20 information required to uniquely identify both the advertisement and the advertisement's current 
instance. 

A third basic component (of a link state method) is that the LSPs are transmitted 
to all of the other switches, and each switch stores the most recently generated LSP from each 
other switch. 

25 For example, after exchanging database description packets with a neighboring 

switch, a switch may find that parts of its topological database are out of date. A "link state 
request packet" is used to request the pieces of the neighbor's database that are more up to date. 
The sending of link state request packets is the last step in bringing up an adjacency. 

A switch that sends a link stale request packet has in mind the precise instance of 

30 the database pieces it is requesting (defined by LS sequence number, LS checksum, and LS age), 
it may receive even more instances in response. Each advertisement requested is specified by its 
LS type, link state ID, and advertising switch. This uniquely identifies the advertisement, but not 
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its instance. Link state request packets are understood to be requests for the most recent instance 
(whatever that might be). 

"Link state update packets" cany a collection of link state advertisements one hop 
further from its origin; several link state advertisements may be included in a single packet. Link 
5 state update packets are multicast on those physical networks that support multi-cast/broadcast. 
In order to make the flooding procedure reliable, flooded advertisements are acknowledged in 
"link state acknowledgment packets." If retransmission of certain advertisements is necessar>\ 
the retransmitted advertisements are carried by unicast link state update packets. 

In summary, there are five distinct types of link state advertisements, each of 
10 which begins with the standard link state header: 

hello 

»- database description 

► link state request 

► link state update 

1 5 ^ link state acknowledgment. 

Each link state advertisement describes a piece of the switch domain. All link 
state advertisements are flooded throiighout the switch domain. The flooding algorithm is 
reliable, insuring that all switches have the same collection of link state advertisements. This 
20 collection of advertisements is called the link state (or topological) database. From the link state 
database or table (see Fig. 7A), each switch constructs a shortest path tree with itself as the root. 
This yields a link slate switching table (see Fig. 7C), which is keyed by switch/port pair. Fig. 7B 
is an example of a link state neighbor table. 

The following fields may be used to describe each switch link. 
25 A "type" field indicates the kind of link being described. It may be a link to a 

transit network, to another switch, or to a stub network. 

A "link ID" field identifies the object that this switch link connects to. When 
connecting to an object that also originates a link state advertisement (i.e., another switch or a 
transit network), the link ID is equal to the other advertisement's link state ID. The link ID 
30 provides the key for looking up an advertisement in the link state database. 
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A "link data" field contains infonnaiion which depends on the link^s type field. 
For example, it may specify a switch's associated port name, which is needed during building of 
the switching table, or when calculating the port name of the next hop. 

A "metrics" field contains the number of different "types of service" (TOS) 
5 metrics for this link, not counting a required metric field TOS 0. For each link, separate metrics 
may be specified for each type of service. The metric is the cost of using an outbound switch 
link, for traffic of the specified TOS. 

Every switch originates a "switch links" advertisement. In addition, at any given 
time one of the switches has been elected to serve as the "Designated Switch." The Designated 
10 Switch also originates a "network links" advertisement for each transit network (i.e., multi-access 
network that has more than one attached switch) in the area. The "network links" advertisement 
describes all switches attached to the network, including the designated switch itself. The 
advertisement's link state ID field lists the Switch ID of the designated switch. The distance 
from the network to all attached switches is zero, for all types of service; thus the TOS and 
15 metric fields need not be specified in the "network links" advertisement. 

A fourth main component (of a link state method) is that each switch, now armed 
with a complete map of the topology (the information in the LSPs yields complete knowledge of 
the graph), computes a path to a given destination. Thus, once the LSPs have been distributed 
and proper protocol adjacencies formed, a Dijkstra algorhhm (see R. Perlman, pp. 221-222, 
20 supra) may be run to compute routes to all known destinations in the network. This is discussed 
further in the following section entitled "Connection Management" 

Some of the beneficial features of the link stale protocol described herein are 
summarized below. 

The link state protocol does not require configuration information. Instead, it 
25 employs the MAC address of a device for unique identification. Ports are also uniquely 
identified using the switch MAC address and a port number instance. 

In addition, the link state protocol has no network layer service provider, as it 
operates at the MAC layer. As a result, the protocol incorporates the required features that are 
typically provided by a network layer provider, such as fragmentation. 
30 In order to provide network layer services, the link stale protocol uses a well- 

known Cabletron Systems. Inc. multicast address (OlOOlDOOOOOO) for all packets sent and 
received. This enables all media to be treated as shared broadcasts, simplifying the protocol. 
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Due to the "flat" nature of switched fabrics, and the unrelated nature of MAC 
address assignments, the present protocol does not provide for summarization of the address 
space (or classical IP subnet information), or level 2 routing (IS-IS Phase V DECNet). There 
exists a single area, and every switch within that area has a complete topology of the switch 
5 fabric. 

Because a single domain exists for the switch fabric, there is no need to provide 
for interdomain reachability. 

Rather than calculating the best next hop as in other link state shortest path first 
algorithms, the present protocol method calculates the best next hops for the entire path. This is 
10 significant in that the path is only determined once, instead of at each switch hop. 

Pflth Determination 

The following is a general example of applying metrics to the path determination. 

15 Example 

As illustrated in Fig. 8, a path may be determined from a call-originating switch 
X 1 { 1 50), for a destination switch X5 ( 1 54). The protocol returns the best (meaning lowest 
aggregated metric) path to X5. This would be the path "e,d" (through switch X4 (1 53)), 
assuming like media and default metric assignments. Path "e,d" has a value of 10. Path "a,b,c" 

20 (through switches X2 (1 5 1) and X3 (152)) has value of 1 5 and would not be chosen. Should link 
"e" fail, the path "a,b,c" would take over and continue to provide connectivity. Should the value 
of the metric be manipulated such that path "a,b,c" and path "e,d" were of equal value, the 
protocol would return both as possible paths. 

Once a path between an ingress switch and egress switch is determined (i.e., the 

25 pre-established or virtual path), the ingress switch sends a source-routed connect message 

(containing an in-order list of switch nodes and links in the path) to set ail switches on the path. 
Each sv^tch on the path maps a connection in its switching table (Fig. 7c) based on the virtual 
path identifier. The fmal (egress) switch on the path sends a path acknowledgment signal back to 
the ingress switch. Later, when the ingress switch receives a data packet intended for a 

30 destination attached to the egress switch, it forwards the data along the virtual path. 
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Rxemplarv FPS Network and Switches 

FIG. 9 shows a representative network topology built with six fast packet 
switches (FPS) labeled S1-S6 and connected by links L. Each switch has for example four ports; 

5 some ports are labeled A for access and some are labeled N for network. The end systems are 

connected to the access ports by links L and are labeled "M One end system is a network 

management station (NMS) or server (M10)> which may also include an external connection 
service and/or a VLAN management application. 

FIG. 10 is a schematic illustration of an FPS switch 170 having a plurality of 

!0 ports 171, A host port 172 connects the switch to its host CPU 173, which may be an I960 
microprocessor sold by Intel Corporation. The host CPU is connected to a system management 
bus (SMB) 1 74 for receipt and transmission of discovery and other control messages. 

FIG. 1 1 illustrates the internal operation of a switch module 178. The FPS switch 
1 86 includes in-ports 1 80, out-ports 1 8 K a connection database 1 82, a look-up engine 1 83, and a 

15 multilevel programmable arbiter MPA 1 84. The FPS switch 1 86 sends and receives messages 
from the host agent 185, which includes a management agent 187, a discovery agent 188» and a 
VLAN agent 189. The management agent 1 87 provides external conuol of the switch through 
the network management system Ml 0. The discovery agent 1 88 provides a mapping of local 
end systems to switching ports through a passive listening (snooping) capability. Adjacent 

20 switches are also discovered and mapped through an explicit switch-to-switch protocol (non- 
passive). The VLAN agent maps VLANs to access ports or end systems. 

FIG. 12 illustrates schematically a VLAN domain 140 in which a plurality of 
VLAN switches 141, 142 are managed by a VLAN management application 143. The switches 
have access ports 144 connected to end systems 145, and network ports 146 connecting the 

25 switches. As previously discussed, a topology exchange occurs between switches 141 and 142. 
The management application 143 commimicates with each switch on links 147 via the SNMP 
(Simple Network Management Protocol) messaging protocol. 

The switches may contain SMNP MIBs for element management and remote 
control of the switch elements. The managed objects accessible by the MIB (Management 

30 Information Base) may be accessed with the standard SNMP Get, GetNext, and Set messages. 
The MIB interface allows an external application to assign the VLAN mappings to access ports 
and/or end systems. 
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Any of the above embodiments may be implemented in a general purpose 
computer 190 as shown in FIG. 13. The computer may include a computer processing unit 
(CPU) 191, memory 192, a processing bus 193 by which the CPU can access the memory 192, 
and access to a network 1 94. 

5 The invention may be a computer apparatus which performs the functions of any 

of the previous embodiments. Alternatively, the invention may be a memory 192. such as a 
floppy disk, compact disk, or hard drive, which contains a computer program or data structure, 
for providing to a general purpose computer instructions and data for carrying out the functions 
of the previous embodiments. 

10 In an alternative embodiment, the "Ether type" Held 33 could be used instead of 

the "VLAN-ID" field 34 for demultiplexing the modified frame. With this approach, the Ether 
type field 45 is remapped over the existing Ether type field 33 of the packet on the ingress 
switch. On the egress switch, the Ether type field 45 is used to demultiplex the frame, and the 
original frame is restored. 

15 In another alternative embodiment, layer 3 (i.e., network layer) snatching could be 

used instead of layer 2 switching in the ingress switch as previously described to accomplish 
aggregation. In this approach, the layer 3 connection would point to the appropriate virtual 
path/virtual circuit. The egress switch would still be multiplexed on the level 2 address. 
Providing layer 3 aggregation allows different quality of service parameters to be used for 

20 different MAC addresses and in essence, provides a higher level of fidelity than layer 2. 

To enable multicasting, special multicast aggregated coruiections could be 
progranuned through the switch cloud. These connections could be established per VLAN, 
allowing multiple multicast destinations to be served by a single set of connections. 

Because the virtual path 31 is a DA-SA pair, it is possible to operate this 

25 invention with legacy devices serving as trunk switches. If a legacy device is an ingress or 
egress switch, then: (1) aggregation cannot be used for traffic terminating with that device; or 
(2) the packet must be demultiplexed by the last non-legacy switch in the cloud before the legacy 
switch. 
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Having thus described several particular embodiments of the invention, various 
modifications and improvements will readily occur to those skilled in the art. Accordingly, the 
foregoing description is by way of example only, and not intended to be limiting. 

5 
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CLAIMS 

1 . A method of establishing a connection comprising: 

receiving a MAC frame packet at an ingress switch, the packet including a source 
address and a destination address; 

determining a virtual path ID for a pre-established path from the ingress switch to 
an egress switch attached to the destination; 

adding the virtual path ID to the packet to create a modified packet; 

sending the modified packet on the pre-established path to the egress switch. 

2. The method of claim 1 , further comprising: 

determining a virtual circuit ID for the source address and destination address; 
removing the source address and destination address from the packet and adding 
the virtual circuit ID to create the modified packet. 

3. The method of claim 1, further comprising: 

upon receipt of the packet at the egress switch, creating a restored MAC frame 
packet and forwarding the restored packet to the destination. 

4. The method of claim 1 , wherein each switch on the pre-established path between 
the ingress switch and egress switch forwards the packet based on the virtual path ID. 

5. The method of claim 1 , wherein the virtual path ID includes an identifier for the 
pre-established path, at least part of an address for the egress switch, and at least part of an 
address for the ingress switch. 

6. The method of claim 2, wherein the egress switch determines the virtual circuit ID 
and sends it to the ingress switch. 

7. The method of claim 2, wherein the virtual circuit ID comprises an out-port and 
out-header on the egress switch to the destination. 
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8. The method of claim 2, wherein the egress switch determines the destination 
address based on the virtual path ID and virtual circuit ID. 

9. The method of claim 2, wherein the virtual circuit ID is removed from the packet 
5 by the egress switch. 

1 0. The method of claim 1 , wherein the source address and destination address are 
removed from the packet at the ingress switch and replaced by the virtual path ID. 

10 11. The method of claim 1 0, wherein the virtual path ID is removed from the packet 

by the egress switch and replaced by the destination address and source address. 



12, A method of forwarding MAC frame data packets in a switched communications 
network, the network including a plurality of source and destination end systems and switches 

15 coimected by links, the switches having access ports coruiccted to end systems and network ports 
coimected to other switches, and each end system having a unique physical address, the method 
comprising the steps of: 

when a first packet is received on an access port of an ingress switch, the ingress 
switch determining a virtual path ID for a pre-established path from the ingress switch to 
20 an egress switch attached to a destination end system, modifying the first packet to 

include the virtual path ID and forwarding the modified packet to the egress switch on the 
pre-established path. 

13. The method of claim 12, wherein the ingress switch replaces a destination 

25 address/source address field in the first packet with the virtual path ID, and the modified packet 
further includes a virtual circuit ID for determining an out-port and out-header on the egress 
switch to the destination end system. 



30 



14. The method of claim 12, wherein an intermediate switch on the established path 
between the ingress switch and egress switch, forwards the packet based upon the virtual path 
ID. 
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1 5. The method of claim 13, wherein the egress switch replaces the virtual path ID 
with the destination address and source address of the first packet, and removes the virtual circuit 
ID. 

16. A method of establishing connections in a switched communications network, the 
network including a plurality of source and destination end systems and switches connected by 
links, the switches having access ports connected to end systems and network ports connected to 
other switches, and each end system having a unique physical address, the method comprising 
the steps of: 

prior to a connection setup for establishing conmiunication between a source end 
system and destination end system, determining pre-established paths between different 
pairs of ingress and egress switches, which pre-established paths are known to the 
respective ingress and egress switches and each intermediate switch therebetween on the 
pre-established path; and 

at a connection setup phase when a MAC frame data packet identifying the 
destination is received at an ingress switch, the ingress switch and an egress switch 
connected to the destination exchanging a message which identifies an out-port and out- 
header on the egress switch for the destination. 

1 7. A method of forwarding data packets in a switched communications network, the 
network including a plurality of source and destination end systems and switches connected by 
links, the switches having access ports connected to end systems and network ports connected to 
other switches, and each end system having a unique physical address, the method comprising 
the steps of: 

reducing the number of connections maintained in the switches by determining 
pre-established paths between select pairs of ingress and egress switches for forwarding 
of MAC frame data packets therebetween. 

18. A method of forwarding data packets in a switched conmfiunications network, the 
network including a plurality of source and destination end systems and switches connected by 
links, the switches having access ports connected to end systems and network ports connected to 
othe switches, and each end system having a unique MAC address, wherein MAC frame packets 
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containing MAC addresses for the source and destination end systems are transmitted on the 
netwoiic, the method comprising the steps of: 

replacing the MAC addresses in the data packet with a virtual path ID for a pre- 
established path from an ingress switch, coimected to the source end system, to an egress 
5 switch, connected to the destination end system. 

19. A method of forwcirding data packets in a switched conununications network, the 
network including a plurality of source and destination end systems and switches connected by 
links, the switches having access ports connected to end systems and network ports connected to 

)0 othe switches, and each end system having a unique MAC address, wherein MAC frame packets 
containing MAC addresses for the source and destination end systems are transmitted on the 
network, the method comprising the steps of: 

transmitting a MAC frame from an ingress switch, coruiected to a source end 
system, to an egress switch, connected to a destination end system, on a pre-established 
15 path from the ingress switch to the egress switch, wherein the packet is reformatted only 

at the ingress and egress switches. 

20. An apparatus for forwarding data packets in a switched communications network, 
the network including a plurality of end systems and switches connected by links, the switches 

20 having access ports connected to end systems and network ports coimected to other switches, and 
each end system having a unique physical address, the apparatus comprising: 

each one of the switches having means for maintaining a connection database of 
pre-established paths between select pairs of ingress and egress switches; and 

when a MAC frame packet is received on a port of one switch, the one switch 
25 having means for accessing its connection database to determine the pre-established path. 
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